Operation apparatus for vehicle

ABSTRACT

An operation apparatus for a vehicle includes a detector configured to detect a motion of a hand; a display apparatus configured to output an operation screen; and a processing device configured to perform, based on the motion of the hand detected by the detector, selection and determination processes for selecting and determining one of selection target items in the operation screen output on the display apparatus. The processing device is configured to form, in a vehicle stop state, a first operation screen related to a predetermined function, the first operation screen being operable based on the motion of the hand, and form, in a vehicle travel state, a second operation screen related to the predetermined function, the second operation screen being different from the first operation screen and operable based on the motion of the hand easier than that in the vehicle stop state.

CROSS REFERENCE

This is a continuation of U.S. Application Ser. No. 15/320,247 filedDec. 19, 2016, which claims priority to PCT International PatentApplication No. PCT/JP2015/064932 filed May 25, 2015, claiming priorityto Japanese Patent Application No. 2014-128580 filed Jun. 23, 2014, theentire contents of which are all incorporated herein by reference.

TECHNICAL FIELD

The disclosure is related to an operation apparatus for a vehicle.

BACKGROUND ART

Such an input method is known (see Patent Document 1, for example) inwhich only a simple hand motion input that does not involve gazing ascreen is performed for a driver, while operations that involve gazingat buttons, a touch panel, etc., are permitted for passengers other thanthe driver.

CITATION LIST

[Patent Document 1] Japanese Laid-open Patent Publication No.2007-302223

SUMMARY Technical Problem

However, according to a configuration disclosed in Patent Document 1,the same screen is formed for a vehicle travel state and a vehicle stopstate, which may cause reduced operability.

It is an object of the present disclosure to provide an operationapparatus for a vehicle which can form operation screens that aredifferent between in a vehicle travel state and in a vehicle stop stateand operable based on a motion of a hand.

Solution to Problem

According to an aspect of the disclosure, an operation apparatus for avehicle is provided, and the operation apparatus includes:

a detector configured to detect a motion of a hand;

a display apparatus configure to output an operation screen; and

a processing device configured to perform, based on the motion of thehand detected by the detector, selection and determination processes forselecting and determining one of selection target items in the operationscreen output on the display apparatus, wherein

the processing device is configured to form, in a vehicle stop state, afirst operation screen related to a predetermined function, the firstoperation screen being operable based on the motion of the hand, andform, in a vehicle travel state, a second operation screen related tothe predetermined function, the second operation screen being differentfrom the first operation screen and operable based on the motion of thehand easier than that in the vehicle stop state.

Advantageous Effects of Invention

According to the present disclosure, an operation apparatus for avehicle can be obtained which can form operation screens that aredifferent between in a vehicle travel state and in a vehicle stop stateand operable based on a motion of a hand.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram schematically illustrating a configuration of anoperation apparatus for a vehicle 1 according to an embodiment.

FIG. 2 is a diagram schematically illustrating an example of a mountingstate of a hand motion detector 10 and a display apparatus 20.

FIG. 3 is a diagram illustrating an example of a first operation screen.

FIG. 4 is a diagram illustrating an example of a second operationscreen.

FIG. 5 is an example of a flowchart of a process executed by aprocessing device 100.

DESCRIPTION OF EMBODIMENTS

In the following, embodiments are described in detail with reference toappended drawings.

FIG. 1 is a diagram schematically illustrating a configuration of anoperation apparatus for a vehicle 1 according to an embodiment. FIG. 2is a diagram schematically illustrating an example of a mounting stateof a hand motion detector 10 and a display apparatus 20. It is notedthat, in FIG. 2, a hand motion operation state of a driver isschematically illustrated.

The illumination apparatus 1 for a vehicle includes a hand motiondetector 10, a determination switch 12, a display apparatus 20, avehicle speed sensor 30, and a processing device 100.

The hand motion detector 10 detects a motion of a hand of a human. Thehand motion detector 10 may be placed at an appropriate location in thevehicle (in an instrument panel, for example). For example, the handmotion detector 10 may be provided in the instrument panel, an arm restin a center console or the like, as illustrated in FIG. 2. A way ofdetecting the motion of the hand of the human is arbitrary, and anoptical detection method may be used. For example, the hand motiondetector 10 may use two or more distance sensors to detect a positionand a motion of the hand. The hand motion detector 10 may use an imagesensor to detect the motion of the hand. The way of detecting the motionof the hand may be such a way disclosed in Japanese Laid-open PatentPublication No. 2007-302223, for example.

The determination switch 12 may be a mechanical switch or a touchswitch. The determination switch 12 may be displaced with a speechinput, etc. The determination switch 12 may be provided in the arm restin the center console or the like, for example.

The display apparatus 20 may be an arbitrary display device such as aliquid crystal display and a HUD (Head-Up Display). The displayapparatus 20 may be placed at an appropriate location in the vehicle (inan instrument panel, for example). The display apparatus 20 may be of atouch panel type, although a type for which the touch operation cannotbe performed is suitable.

The vehicle speed sensor 30 outputs an electric signal according torotational speed of vehicle wheels (vehicle speed pulses) to the controlECU 40.

The processing device 100 may be implemented by an ECU (ElectronicControl Unit). The ECU may include a microprocessor that includes a CPU,a ROM, a RAM, etc., (not shown) which are interconnected via appropriatebuses. The processing device 100 includes a control part 102, anoperation process part 104, and a display process part 106. The parts102, 104, and 106 may be implemented by the CPU executing programsstored in a storage device such as ROM. The parts 102, 104, and 106 areimaginary, and a program for implementing a certain part may bepartially or totally incorporated in a different part. Further, theparts 102, 104, and 106 are not necessarily incorporated in the same ECUand thus may be implemented by several ECUs in cooperation.

The control part 102 controls a display of the display apparatus 20 incooperation with the operation process part 104 and the display processpart 106. Further, the control part 102 controls function implementationdevices 40 in cooperation with the operation process part 104 and thedisplay process part 106. The function implementation devices 40 arearbitrary, but may include an audio apparatus, a TV, a navigationapparatus, an air conditioner, etc., for example.

The operation process part 104 processes inputs from the hand motiondetector 10. The operation process part 104 detects hand motionoperations based on the input from the hand motion detector 10. The handmotion operations may be operations with the hand as a whole moving inleft and right directions, operations with the hand as a whole moving inup and down directions, an operation with a finger pointing in anarbitrary particular direction, etc. It is noted that the hand motionoperations to be detected by the operation process part 104 may changeaccording to differences between operation screens on the displayapparatus 20. In other words, the hand motion operations allocated tofirst operation screen and second operation screens, respectively, maydiffer. Further, the operation process part 104 processes an input fromthe determination switch 12. The operation process part 104 determines,based on the input from the determination switch 12, the presence orabsence of the determination operation.

The display process part 106 controls the display of the displayapparatus 20 in synchronization with the hand motion operations and incooperation with the control part 102 to assist the hand motionoperations. Specifically, the display process part 106 displays theoperation screen on the display apparatus 20, and performs selection anddetermination processes for selecting and determining one of selectiontarget items, etc. The determination process for the selected selectiontarget item is implementing the function related to the selectedselection target item, and includes a screen transition process, a textoutput process, a process of outputting an instruction (control signal)to the function implementation devices 40, etc., for example.

The selection target items form imaginary operation buttons (which meansthat the selection target items are not buttons of a mechanical typethat are directly operated by hand). The selection target items(operation buttons) may be related to any types (functions). In otherwords, the functions (i.e., the selection target items) executable bythe hand motion operations are arbitrary. For example, the selectiontarget items may be to be operated for requesting (calling) a screen forvarious settings for a navigation apparatus or a map screen (including adisplay of the current position, for example) to be displayed on thedisplay 20. Further, the selection target items may be operated forvarious settings for an air conditioner, or for requesting its operationscreen to be displayed on the display 20. Further, the selection targetitems may be operated for various settings (a volume adjustment, etc.)for an audio apparatus or a TV, or for requesting its operation screento be displayed on the display 20. Further, the selection target itemsmay include selection target items (icons, launchers, widgets, etc.) forstarting up any application. Further, the selection target items mayinclude text input buttons in the operation screen such as an operationscreen for inputting the Japanese syllabary, etc.

The display process part 106 changes the operation screen of the displayapparatus 20 in cooperation with the control part 102 according to avehicle travel state or a vehicle stop state. Specifically, in thevehicle stop state, the control part 102 provides the display processpart 106 with an instruction to form the first operation screen. Thefirst operation screen is such that relatively complex operations withthe hand motion operations are possible. In the vehicle travel state,the control part 102 provides the display process part 106 with aninstruction to form the second operation screen. The second operationscreen is such that only relatively easy operations with the hand motionoperations are possible. The first operation screen and the secondoperation screen are related to the same function (i.e., of the sametype), and may be prepared on a function basis. For example, the firstoperation screen and the second operation screen are prepared as anoperation screen related to the air conditioner, for example,respectively. The operation screens related to the same function may beoperation screens related to the same function implementation device 40,operation screens related to the same setting of the same functionimplementation device 40, operation screens (top layer operationscreens) for selecting (calling) one of the function implementationdevices 40 to be operated, etc., for example.

FIG. 3 is a diagram illustrating an example of the first operationscreen. In FIG. 3, a hand S at the hand motion operation isschematically illustrated.

The first operation screen illustrated in FIG. 3 is used for selecting amusical composition to be played on the audio apparatus. The firstoperation screen illustrated in FIG. 3 includes the selection targetitems related to 7 musical compositions in three disks (CDs, MDs, etc.),respectively. In this case, a user has 21 options for the selectiontarget item by moving a pointer 80 on this first operation screen.

The display process part 106 displays the pointer 80 on the firstoperation screen. The display process part 106 changes the displayedposition of the pointer 80 according to a finger pointing directiondetected by the operation process part 104. For example, the controlpart 102 calculates, based on the finger pointing direction and theposition of the finger detected by the operation process part 104,corresponding coordinates on the display apparatus 20. In other words,the control part 102 calculates the corresponding coordinates of theoperation screen on the display apparatus 20 at an intersection with anextended line of the finger pointing direction. The display process part106 renders the pointer 80 at the coordinates calculated by the controlpart 102. When the user changes the finger pointing direction, thecontrol part 102 calculates the corresponding coordinates on the displayapparatus 20 based on the changed finger pointing direction and thechanged position of the finger. The display process part 106 renders(moves) the pointer 80 at the coordinates calculated by the control part102. It is noted that when the user presses the determination switch 12while the pointer 80 is on his/her desired selection target item, thecontrol part 102 implements the function related to the selection targetitem having the pointer 80 thereon. As a result of this, in the exampleillustrated in FIG. 3, the user can select and play the musicalcomposition “Song name 3” in the disk 2, for example.

It is noted that, in the example illustrated in FIG. 3, although thepointer 80 is illustrated as an example, a cursor may be used instead ofthe pointer 80. The cursor represents the selection target item itselfthat is currently displayed in a selected state. Thus, the position ofthe cursor corresponds to the position of the selection target itemdisplayed in the selected state. It is noted that, in an initial stateof the first operation screen, any one of the selection target items maybe displayed in the selected state as a default, or none may bedisplayed in the selected state. It is noted that a way of implementingthe selected state (i.e., the image of the cursor) may be arbitrary aslong as the operator can recognize that the selection target itemdisplayed in the selected state is selected. For example, the selectedstate may be implemented by making a luminance, a color, etc., of theselection target item to be displayed in the selected state differentfrom that of other selection target items, or featuring a boundary ofthe selection target item to be displayed in the selected state withrespect to that of other selection target items.

FIG. 4 is a diagram illustrating an example of the second operationscreen. In FIG. 4, hands S1 and S2 at the hand motion operation areschematically illustrated.

The display process part 106 renders the selection target item, which iscurrently being executed, at a specific location (a center in theexample illustrated in FIG. 4) on the second operation screen. In thefollowing, the selection target item rendered at the specific location(a center in the example illustrated in FIG. 4) on the second operationscreen is referred to as “an execution selection target item”. In theexample illustrated in FIG. 4, the selection target item “Song name 1”in the disk 2 is the execution selection target item, and thus thesecond operation screen represents a state in which the musicalcomposition “Song name 1” in the disk 2 is being selected and played.The display process part 106 does not display the pointer 80 on thesecond operation screen.

The display process part 106 changes, based on the direction of the handmotion operation detected by the operation process part 104, theexecution selection target item and implements the function according tothe execution selection target item. At that time, the determinationoperation with the determination switch 12 by the user is not necessary.Specifically, in the displayed state of the second operation screen, thedisplay process part 106 simultaneously implements the selection anddetermination processes upon the hand motion operation. In the exampleillustrated in FIG. 4, the selection target items related to “Song name7” and “Song name 2” in the disk 2 are rendered on the upper side andthe lower side of the execution selection target item (“Song name 1” inthe disk 2), respectively. When the hand motion operation (i.e., theaction with the hand as a whole) in the up or down direction is detectedby the operation process part 104, the control part 102 changes theselection target item in the up or down direction one by one to changethe execution selection target item, and implements the functionaccording to the changed execution selection target item. For example,when the user performs the hand motion operation in the up direction,“Song name 2” in the disk 2 becomes the execution selection target itemto be played.

Similarly, in the example illustrated in FIG. 4, the selection targetitems related to “Song name 1” in the disk 1 and “Song name 1” in thedisk 3 are rendered on the left side and the right side of the executionselection target item (“Song name 1” in the disk 2), respectively. Whenthe hand motion operation (i.e., the action with the hand as a whole) inthe left or right direction is detected by the operation process part104, the control part 102 changes the selection target item in the leftor right direction one by one to change the execution selection targetitem, and implements the function according to the changed executionselection target item. In other words, the change between the disks isimplemented. For example, when the user performs the hand motionoperation in the left direction, “Song name 1” in the disk 3 becomes theexecution selection target item to be played, as S1 illustrated in FIG.4. Further, when the user performs the hand motion operation in theright direction, “Song name 1” in the disk 1 becomes the executionselection target item to be played, as S2 illustrated in FIG. 4. In thisway, in the example illustrated in FIG. 4, the user has 4 options forthe selection target item that can be changed with the hand motionoperations on this second operation screen. However, by performing thehand motion operations a plurality of times, it becomes possible for theuser to play the desired musical composition.

In this way, the second operation screen enables only the operationswith the hand motion operations that are easier than those with respectto the first operation screen. Thus, even in the vehicle travel state,the operability with the hand motion operations can be increased withoutsubstantially interfering with the driver′ concentration on the driving.It is noted that, in the example illustrated in FIG. 3 and FIG. 4, thefirst and second operation screens are illustrated as an example ofoperation screens related to the play function of the audio apparatus;however, other functions can also be implemented similarly. However,there may be such a function, such as a Japanese syllabary inputfunction, etc., for which the second operation screen is not formed(i.e., the function that is implemented by only the first operationscreen).

FIG. 5 is an example of a flowchart of a process executed by theprocessing device 100. The process illustrated in FIG. 5 is implementedduring a period in which the operation screen related to the functionfor which the first and second operation screens are prepared is beingoutput.

In step S501, the processing device 100 waits for the detection of thehand motion operation based on the detection result from the hand motiondetector 10. When the processing device 100 detects the hand motionoperation, the process goes to step S502.

In step S502, the processing device 100 obtains vehicle speedinformation from the vehicle speed sensor 30. It is noted that thevehicle speed information may be obtained based on the change in the ownvehicle position from a GPS receiver, rotation speed of an output shaftof a transmission, etc.

In step S503, the processing device 100 determines, based on the vehiclespeed information, whether the vehicle is traveling. If it is determinedthat the vehicle is traveling (i.e., in the vehicle travel state), theprocess goes to step S504, otherwise (i.e., in the vehicle stop state)the process goes to step S507. In step S503, the processing device 100determines, based on the vehicle speed information, whether the vehicleis in the stop state. In this case, the processing device 100 maydetermines that the vehicle is in the stop state when the vehicle speedis 0 and a brake operation is being performed.

In step S504, the processing device 100 displays the second operationscreen. The second operation screen is as described above.

In step S505, the processing device 100 determines whether the handmotion operation detected in step S501 described above corresponds toone of predetermined hand motion operations allocated to the secondoperation screen that is being displayed. The predetermined hand motionoperations allocated to the second operation screen may be the handmotion operations with the hand as a whole in the left and rightdirections and/or the up and down directions (see FIG. 4). If it isdetermined that the hand motion operation corresponds to one of thepredetermined hand motion operations allocated to the second operationscreen, the process goes to step S506, otherwise the process for thehand motion operation detected at this time directly ends (i.e., theprocess ends without any special process for the hand motion operationdetected at this time).

In step S506, the processing device 100 executes the functioncorresponding to the hand motion operation detected in step S501described above (refers to the explanation with respect to FIG. 4, forexample).

In step S507, the processing device 100 displays the first operationscreen. The first operation screen is as described above.

In step S508, the processing device 100 determines whether the handmotion operation detected in step S501 described above corresponds toone of predetermined hand motion operations allocated to the firstoperation screen that is being displayed. The predetermined hand motionoperations allocated to the first operation screen may be the operationswith the finger pointing in the particular directions (see FIG. 3). Ifit is determined that the hand motion operation corresponds to one ofthe predetermined hand motion operations allocated to the firstoperation screen, the process goes to step S509, otherwise the processfor the hand motion operation detected at this time directly ends (i.e.,the process ends without any special process for the hand motionoperation detected at this time).

In step S509, the processing device 100 executes the functioncorresponding to the hand motion operation detected in step S501described above (refers to the explanation with respect to FIG. 3, forexample).

According to the process illustrated in FIG. 5, the second operationscreen can be output in the vehicle travel state, while the firstoperation screen can be output in the vehicle stop state. The secondoperation screen is related to the same function as the first operationscreen, as described above, but the second operation screen is differentfrom the first operation screen and a dedicated operation screen foraccepting the hand motion operations easier than those to be accepted inthe first operation screen. Thus, even in the vehicle travel state, theoperability with the hand motion operations can be increased withoutsubstantially interfering with the driver′ concentration on the driving.

All examples and conditional language recited herein are intended forpedagogical purposes to aid the reader in understanding the inventionand the concepts contributed by the inventor to furthering the art, andare to be construed as being without limitation to such specificallyrecited examples and conditions, nor does the organization of suchexamples in the specification relate to a showing of the superiority andinferiority of the invention. Although the embodiment(s) of the presentinventions have been described in detail, it should be understood thatthe various changes, substitutions, and alterations could be made heretowithout departing from the spirit and scope of the invention. Further,all or part of the components of the embodiments described above can becombined.

What is claimed is:
 1. An operation apparatus for a vehicle, theoperation apparatus comprising: a detector configured to detect a motionof a hand; a display apparatus configure to output an operation screen;and a processing device configured to perform, based on the motion ofthe hand detected by the detector, selection and determination processesfor selecting and determining one of selection target items in theoperation screen output on the display apparatus, wherein the processingdevice is configured to form, in a vehicle stop state, a first operationscreen related to a predetermined function, the first operation screenbeing operable based on the motion of the hand, and form, in a vehicletravel state, a second operation screen related to the predeterminedfunction, the second operation screen being operable to execute only oneof the selection target items.
 2. The operation apparatus for a vehicleof claim 1, wherein the first operation screen is such that a pointer ora cursor can be moved to a position corresponding to a direction pointedby a finger.
 3. The operation apparatus for a vehicle of claim 2,wherein the second operation screen is such that selection target itemsto be executed are changed one by one according to an action of the handas a whole moving in up and down directions or left and rightdirections.
 4. The operation apparatus for a vehicle of claim 1, whereinthe first operation screen is such that more than one of the selectiontarget items can be executed in response to the motion of the hand. 5.The operation apparatus for a vehicle of claim 1, wherein one of theselection target items on the first operation screen is executable inresponse to an input to a determination switch.
 6. The operationapparatus for a vehicle of claim 1, wherein one of the selection targetitems on the second operation screen is executable in response to themotion of the hand.
 7. A method for performing an operation in avehicle, comprising: detecting a hand motion operation; obtainingvehicle speed information from a vehicle speed sensor; determining,based on the vehicle speed information, whether the vehicle is in atravel state or a stop state; when the vehicle is in a stop state,displaying a first operation screen on a display, wherein the firstoperation screen includes a plurality of executable selection targetitems; when the vehicle is in a travel state, displaying a secondoperation screen on the display, wherein the second operation screenincludes one executable selection target item; determining whether thehand motion operation detected corresponds to one of predetermined handmotion operations; when the hand motion operation detected correspondsto a predetermined hand motion operation, executing a functionassociated with the predetermined hand motion operation.